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Abstract 

Comprehensive  identification  of  chemical  contaminants  in  Army  field  water  supplies  can  be  a  lengthy  process,  but  rapid  analytical  methods 
suitable  for  field  use  are  limited.  A  complementary  approach  is  to  directly  measure  toxicity  instead  of  individual  chemical  constituents.  Ten  toxicity 
sensors  utilizing  enzymes,  bacteria,  or  vertebrate  cells  were  tested  to  determine  the  minimum  number  of  sensors  that  could  rapidly  identify  toxicity 
in  water  samples  containing  one  of  12  industrial  chemicals.  The  ideal  sensor  would  respond  at  a  concentration  just  exceeding  the  Military  Exposure 
Guideline  (MEG)  level  for  the  chemical  (an  estimated  threshold  for  adverse  effects)  but  below  the  human  lethal  concentration.  Chemical  solutions 
were  provided  to  testing  laboratories  as  blind  samples.  No  sensors  responded  to  deionized  water  blanks,  and  only  one  sensor  responded  to  a  hard 
water  blank.  No  single  toxicity  sensor  responded  to  more  than  six  chemicals  in  the  desired  response  range,  and  one  chemical  (nicotine)  was  not 
detected  by  any  sensor  with  the  desired  sensitivity.  A  combination  of  three  sensors  (Microtox,  the  Electric  Cell  Substrate  Impedance  Sensing  (ECIS) 
test,  and  the  Hepatocyte  low  density  lipoprotein  (LDL)  uptake  test)  responded  appropriately  to  nine  of  twelve  chemicals.  Adding  a  fourth  sensor 
(neuronal  microelectrode  array)  to  the  test  battery  allowed  detection  of  two  additional  chemicals  (aldicarb  and  methamidophos),  but  the  neuronal 
microelectrode  array  was  overly  sensitive  to  paraquat.  Evaluating  sensor  performance  using  a  standard  set  of  chemicals  and  a  desired  sensitivity 
range  provides  a  basis  both  for  selecting  among  available  toxicity  sensors  and  for  evaluating  emerging  sensor  technologies.  Recommendations  for 
future  toxicity  sensor  evaluations  are  discussed. 

©  2005  Elsevier  B.V.  All  rights  reserved. 
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1.  Introduction 

Providing  high  quality  drinking  water  free  from  chemical 
contaminants  is  important  both  for  Army  facilities  in  the  United 
States  as  well  as  for  Army  personnel  deployed  around  the 
world.  During  deployments,  producing  drinking  water  at  a  cen¬ 
tral  source  and  transporting  it  to  personnel  in  the  field  may 
improve  quality  control,  but  central  water  production  requires 
valuable  transportation  assets.  Decentralized  water  production 
makes  it  more  difficult  to  ensure  that  water  is  free  from  chemi¬ 
cal  contamination,  since  options  for  rapid  analysis  of  chemical 
contaminants  are  limited  and  more  thorough  analysis  for  a  broad 
range  of  organic  and  inorganic  chemicals  can  require  complex 
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instrumentation  not  readily  available  in  many  deployed  situa¬ 
tions.  One  alternative  is  to  use  biosensors  that  rapidly  evaluate 
the  toxicity  of  a  whole  water  sample  instead  of  measuring  con¬ 
centrations  of  specific  chemical  constituents.  To  this  end,  an 
effort  was  initiated  to  identify  a  battery  of  toxicity  sensors  that 
could  increase  the  Army’s  capability  to  rapidly  evaluate  drinking 
water  quality.  The  process  described  here  provides  an  efficient 
method  for  screening  available  toxicity  sensors  and  for  selecting 
those  best  suited  for  inclusion  in  a  toxicity  testing  system. 

Previous  efforts  to  evaluate  groups  of  toxicity  sensors  for 
drinking  water  evaluation  have  focused  on  testing  the  sensors 
against  single  benchmark  indicators  of  human  health  effects. 
The  US  Environmental  Protection  Agency  Environmental  Tech¬ 
nology  Verification  (EPA  ETV)  Program  tested  eight  commer¬ 
cially  available  rapid  toxicity  test  systems  against  nine  contam¬ 
inants  at  concentrations  at  and  below  an  estimated  human  lethal 
concentration  (http://www.epa.gov/etv/verifications/vcenterl- 
27.html).  In  addition,  several  potential  interfering  chemicals 
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associated  with  the  water  treatment  process  were  tested  at  sin¬ 
gle  concentrations  likely  to  be  encountered  at  water  treatment 
facilities.  Toxicity  response  thresholds  were  reported,  with  test 
responses  above  the  human  lethal  concentration  considered  to 
be  non-detects. 

In  a  similar  effort,  toxicity  sensors  for  drinking  water  pro¬ 
tection  were  evaluated  at  the  EILATox-Oregon  Biomonitoring 
Workshop  (Pancrazio  et  al.,  2004).  Eleven  toxicity  sensors  were 
tested  with  up  to  17  blind  samples  that  included  a  wide  range 
of  toxic  chemicals  at  maximum  concentrations  selected  to  be 
acutely  toxic  based  on  animal  data.  Sensors  were  scored  as 
either  detecting  or  being  non-responsive  to  the  blind  samples,  but 
because  of  testing  limitations,  7  of  the  1 1  toxicity  sensors  were 
tested  at  less  than  the  maximum  blind  sample  concentration,  at 
dilutions  ranging  from  1 :2  to  1 :200.  Because  of  time  limitations 
at  the  workshop,  not  all  the  toxicity  sensors  were  tested  with  all 
17  blind  samples. 

Our  effort  drew  from  and  expanded  upon  these  sensor  eval¬ 
uations.  We  used  blind  samples  and  tested  each  sensor  using  a 
series  of  toxicant  concentrations  to  define  a  common  endpoint 
across  all  test  chemicals.  Both  toxic  chemicals  and  potential 
interferences  were  tested.  Each  chemical  was  tested  in  tripli¬ 
cate  to  provide  an  estimate  of  test  variability.  As  with  both 
the  EPA  ETV  Program  and  the  EILATox  Workshop,  we  used 
an  estimated  human  lethal  dose  as  an  upper  limit  for  accept¬ 
ability  of  toxicity  sensor  response,  but  we  also  added  a  lower 
response  threshold  to  help  assess  false  positive  responses.  This 
concentration  range  was  established  based  on  toxicity  sensor 
performance  requirements  developed  in  coordination  with  Army 
users. 

As  a  first  step  towards  defining  toxicity  sensor  performance 
requirements,  an  Army  user  group  identified  several  specific 
Army  scenarios  that  required  water  quality  evaluations,  ranging 
from  water  use  by  small  units  in  the  field  to  more  established 
water  treatment  facilities  found  in  rear  areas  and  at  garrisons. 
Equipment  constraints  increase  substantially  in  field  environ¬ 
ments;  size,  weight,  power  consumption,  and  reagent  require¬ 
ments  must  decrease  greatly.  These  logistical  issues  are  being 
addressed  as  part  of  a  formal  Army  toxicity  sensor  downselec- 
tion  process  (ECBC  DAT,  2004)  and  are  not  discussed  further 
here.  This  paper  describes  toxicity  sensor  performance  data 
required  for  the  downselection  process,  including  sensitivity  to 
toxicants  and  test  reproducibility. 

An  initial  evaluation  of  the  literature  identified  38  potential 
toxicity  sensor  technologies  that  might  contribute  to  one  or  more 
of  the  identified  Army  water  use  scenarios.  An  expert  panel 
including  individuals  affiliated  with  Government,  academia,  or 
industry  (including  water  utilities)  selected  the  most  promis¬ 
ing  sensors  for  further  consideration.  Some  technologies  were 
dropped  from  consideration  for  a  variety  of  reasons,  such  as  tak¬ 
ing  too  long  to  produce  a  response  (several  hours  or  more)  or 
being  redundant  with  other  technologies.  Toxicity  sensors  with 
promise  but  at  too  early  a  stage  of  development  to  allow  inclu¬ 
sion  in  a  prototype  system  by  the  end  of  2008  were  included  on 
a  technology  watch  list.  Ten  of  the  38  technologies  were  recom¬ 
mended  for  further  testing  to  allow  a  comparison  of  their  toxicity 
response  characteristics. 


The  comparative  evaluation  of  the  10  toxicity  sensors 
included  the  following  steps: 

•  Identification  of  toxicological  benchmarks.  Defining  the  con¬ 
centration  range  that  constitutes  an  acceptable  sensitivity  for 
the  toxicity  sensors. 

•  Selection  of  test  chemicals.  Identifying  a  set  of  common  test 
chemicals  that  would  permit  meaningful  comparisons  among 
the  toxicity  sensors. 

•  Providing  test  chemical  solutions  as  blind  samples.  Since  tox¬ 
icity  sensors  testing  was  conducted  by  several  laboratories, 
common  test  solutions  were  sent  out  from  a  central  source  as 
blind  samples. 

•  Defining  performance  metrics  and  analyzing  test  results.  The 
goal  was  to  identify  the  minimum  number  of  toxicity  sensors 
that  would  identify  the  maximum  number  of  test  chemicals 
with  the  desired  level  of  sensitivity.  Data  on  test  reproducibil¬ 
ity  and  failure  rate  were  evaluated  as  well. 

2.  Methods 

2.1.  Toxicity  sensors 

The  10  toxicity  sensors  evaluated  in  this  study  by  participat¬ 
ing  laboratories  are  described  below. 

2.1.1.  Electric  cell-substrate  impedance  sensing  (ECIS) 

The  ECIS  device  measured  toxicant-induced  changes  in  the 
electrical  impedance  of  a  cell  monolayer  (Giaever  and  Keese, 
1993;  Keese  et  al.,  1998).  Bovine  pulmonary  artery  endothelial 
cells  from  VEC  Technologies  (Rensselaer,  NY)  were  seeded 
on  eight  small  gold  electrodes  (Applied  BioPhysics  #8W1E) 
and  grown  to  confluence.  Current  flowed  between  the  smaller 
cell-covered  electrode  and  a  larger  counter  electrode  through 
cell  culture  medium  that  bathed  both  electrodes.  After  back¬ 
ground  impedance  was  measured,  the  test  or  control  sample  was 
added  and  impedance  was  measured  for  up  to  60  min;  the  actual 
response  time  was  from  5-20  min  for  all  but  one  of  the  chemicals 
tested. 

2.1.2.  Eclox 

The  Eclox  acute  toxicity  sensor  (Severn  Trent  Services,  Col¬ 
mar,  PA)  monitored  a  chemiluminescent  oxidation-reduction 
reaction  catalyzed  by  the  plant  enzyme  horseradish  peroxidase 
(Hayes  and  Smith,  1996;  States  et  al.,  2003).  In  contaminant- 
free  water,  light  produced  was  detected  by  a  photometer.  In  the 
presence  of  a  contaminant,  chemiluminescence  was  reduced. 
Reagents  were  added  to  a  water  sample  in  a  disposable  cuvette, 
and  a  photometer  reading  was  taken  after  4  min. 

2.1.3.  Hepatocyte  low  density  lipoprotein  (LDL)  uptake 

This  sensor  measured  fluorescein  isothiocyanate  labeled 
LDL-uptake  activity  of  human  hepatoblastoma  Hep  G2  cells 
(Shoji  et  al.,  1998,  2000).  Cells  were  cultured  in  porous  micro¬ 
carriers  at  a  high  cell  density  and  packed  in  a  filter  tip  that  had  a 
hydrophobic  membrane.  Filter  tips  were  then  frozen  at  —  85  °C 
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and  kept  for  at  least  30  days  until  used.  To  analyze  a  water  sam¬ 
ple,  the  filter  tips  were  thawed  for  20  min  and  then  held  in  culture 
media  for  30  min.  The  culture  media  in  the  filter  tip  was  then 
exchanged  for  a  water  sample  in  a  concentrated  culture  medium 
containing  fluorescently  labeled  LDL.  The  cells  were  exposed  to 
the  water  sample  for  2  h,  then  LDL  that  had  not  been  taken  into 
the  cells  was  rinsed  away,  the  cell  membranes  were  lysed,  and  the 
fluorescently  labeled  LDL  was  released  for  fluorescent  measure¬ 
ment.  The  fluorescence  from  LDL  taken  up  during  contaminant 
exposure  was  compared  to  fluorescence  from  cells  exposed  to 
contaminant-free  water.  (Since  the  performer  of  this  assay  was 
located  in  Japan,  the  test  chemicals  for  this  toxicity  sensor  were 
not  provided  as  blind  samples.) 

2.1.4.  Microtox 

The  Microtox  acute  toxicity  sensor  (Strategic  Diagnostics, 
Inc.,  Newark,  DE)  measured  changes  in  natural  bioluminescence 
produced  by  the  marine  bacteria  Vibrio  fischeri  (Bulich,  1979; 
States  et  ah,  2003).  Toxic  substances  decreased  light  output, 
which  was  measured  using  a  photometer.  Vibrio  fischeri  supplied 
in  a  standard  freeze-dried  (lyophilized)  state  were  reconstituted 
in  a  salt  solution.  Luminescence  readings  were  taken  prior  to 
adding  the  water  samples  and  at  15  min  after  the  addition. 

2.1.5.  M it  os  can 

Mitoscan  (Harvard  Bioscience,  Inc.,  Holliston,  MA)  mea¬ 
sured  enzyme  activity  of  submitochondrial  particles  (SMPs), 
which  are  isolated  vesicles  of  the  inner  membrane  of  bovine  heart 
mitochondria  containing  membrane-bound  enzymes  associated 
with  cellular  electron  transport  and  oxidative  phosphorylation 
(Knobeloch  et  al.,  1990).  Two  endpoints  were  monitored  for 
each  chemical  tested:  loss  of  nicotinamide  adenine  dinucleotide 
(NADH)  using  the  electron  transfer  (ETR)  protocol  and  produc¬ 
tion  of  NADH  using  the  reverse  electron  transfer  (RET)  protocol. 
In  both  protocols,  a  concentrated  reaction  mixture  and  SMPs 
were  added  to  the  test  samples.  Then,  either  NADH  (for  ETR)  or 
adenosine  triphosphate  (for  RET)  was  added  to  the  test  samples 
and  the  loss  or  production  of  NADH  was  measured,  respectively, 
over  a  24-min  exposure  period. 

2.1.6.  Neuronal  microelectrode  array 

This  toxicity  sensor  evaluated  changes  in  action  potential 
(AP)  activity,  measured  as  mean  spike  rate,  in  a  neuronal  net¬ 
work  via  non-invasive  extracellular  recording  (Pancrazio  et  al., 
2003).  Mouse  frontal  cortex  neurons  and  glia  grown  on  micro¬ 
electrode  arrays  (MEAs)  were  purchased  from  the  Center  for 
Network  Neuroscience  at  the  University  of  North  Texas  (UNT). 
The  cultures  were  isolated  from  embryonic  day  14—15  mice  and 
seeded  onto  arrays  at  UNT.  After  forming  mature  networks  (3^f 
weeks),  the  cultures  on  the  MEAs  were  shipped  to  the  Naval 
Research  Laboratory  (NRL)  where  the  cultures  were  maintained 
in  a  standard  laboratory  incubator  up  to  5  days  until  use. 

To  initiate  sample  analysis,  the  neural  network  cartridges 
were  equilibrated  at  37  °C  and  pH  7.4.  Then,  a  15  min  low- 
resolution  recording  was  made  of  all  64  microelectrode  channels 
in  order  to  determine  active  electrode  sites.  Only  networks  with 
a  minimum  of  eight  active  channels  (defined  as  having  a  spike 


rate  >  0.5  Hz)  were  used  for  these  experiments.  After  determin¬ 
ing  the  active  channels  present  in  the  network,  up  to  16  were 
chosen  for  high  resolution  recording  and  contaminant  testing. 
After  the  channels  were  selected,  the  network  was  attached  to 
the  biosensor’s  fluidics  system  and  fresh  medium  was  perfused 
across  the  network.  Experiments  began  after  a  stable  baseline 
was  observed  for  30-60  min.  For  each  chemical,  the  network 
was  exposed  to  increasing  test  chemical  concentrations  at  30  min 
intervals. 

2.1.7.  Sinorhizobium  meliloti  toxicity  test 

This  test  used  the  bacterium  S.  meliloti,  which  readily  reduced 
the  tetrazolium  dye  MTT  (Botsford,  2002).  The  normally  light 
yellow  dye  turned  dark  blue  when  reduced  by  the  bacteria; 
toxic  chemicals  inhibited  reduction  of  the  dye.  The  change  in 
color  was  monitored  with  a  spectrophotometer  that  measured 
the  absorbance  at  550  nm  at  time  zero  and  after  incubation  for 
20  min  at  30  °C.  The  absorbance  of  the  unknown  samples  was 
compared  to  distilled  water  controls. 

2.1.8.  SOS  cytosensor  system 

This  toxicity  sensor  measured  changes  in  the  optical  appear¬ 
ance  (pigment  granule  distribution)  of  fish  chromatophores 
(Dierksen  et  al.,  2004).  Both  direct  effects  of  toxic  agents  (“direct 
optical  responses”,  DOR)  and  indirect  effects  (“indirect  opti¬ 
cal  response”,  IOR)  were  measured  after  a  60  min  exposure 
period.  IORs  occurred  when  the  normal  responses  of  chro¬ 
matophores  to  an  added  neurotransmitter  (naphazoline)  were 
disrupted.  Chromatophores  used  were  on  scales  from  the  Nile 
tilapia  ( Oreochromis  niloticus). 

Changes  in  chromatophores  were  recorded  photographically. 
Test  articles  (comprised  of  eight  chambers  and  eight  fish  scales) 
were  mounted  in  a  white-light  illuminated  framework  above 
a  10  x  microscope  lens.  A  digital  camera  coupled  to  the  lens 
recorded  the  image  of  the  fish  scale  in  each  chamber.  Raw 
image  data  were  converted  to  numerical  metrics  through  dig¬ 
ital  color  segmentation.  Black  melanophores,  which  to  date  are 
the  most  studied  chromatophores,  were  demarcated  for  quantita¬ 
tive  measurements.  If  preliminary  inspection  of  the  raw  images 
showed  that  any  of  the  other  major  classes  of  chromatophores 
(e.g.,  yellow  xanthophores)  varied  significantly  with  experimen¬ 
tal  treatment,  then  that  class  also  was  demarcated  and  included  as 
a  class  of  interest  in  the  following  data  processing  steps.  DOR 
and  IOR  values  were  measured  and  evaluated  for  each  single 
fish  scale  by  digital  measurements.  Toxicant  concentrations  that 
caused  significant  changes  in  chromatophore  pigmentation  as 
compared  with  control  chromatophores  were  identified. 

2.1.9.  Toxi-Chromotest 

The  Toxi-Chromotest  (Environmental  Biodetection  Products 
Inc.,  Brampton,  Ont.)  measured  toxicant  inhibition  of  the  de 
novo  synthesis  of  an  inducible  enzyme — [3-galactosidase — in 
a  highly  permeable  mutant  of  Escherichia  coli  (Reinhartz  et 
al.,  1987).  The  sensitivity  of  the  test  was  enhanced  by  expos¬ 
ing  the  bacteria  to  stressing  conditions  and  then  lyophilizing 
them.  Lyophilized  bacteria  were  rehydrated  in  a  cocktail  con¬ 
taining  a  specific  inducer  of  [3-galactosidase  and  essential  factors 
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required  for  the  recovery  of  the  bacteria.  The  activity  of  the 
induced  enzyme  released  by  actively  growing  recovered  cells 
was  detected  by  the  hydrolysis  of  a  chromogenic  substrate.  Toxic 
materials  interfered  with  the  recovery  process  and  thus  with 
the  synthesis  of  the  enzyme  and  the  resultant  color  reaction. 
After  bacteria  were  exposed  to  a  test  chemical  for  75  min,  the 
chromogenic  substrate  was  added.  Samples  were  analyzed  in  a 
96-well  plate  and  the  results  were  read  with  a  plate  reader. 

2.1.10.  ToxScreen  II 

The  ToxScreen  II  test  (Checklight  Ltd.,  Israel)  measured 
changes  in  light  output  from  the  naturally  luminescent  bacte¬ 
ria  Photobacterium  leiognathi  (strain  SB)  (Ulitzur  et  al.,  2002). 
The  test  included  the  use  of  two  assay  buffers;  one  favored 
the  detection  of  heavy  metals  (Pro-Metal  Buffer)  while  the 
other  enhanced  detection  of  organic  contaminants  (Pro-Organic 
Buffer). 

To  analyze  a  test  sample,  a  suspension  of  lyophilized  P.  leiog¬ 
nathi  was  added  to  two  aliquots  of  the  test  sample.  One  aliquot 
received  Pro-Metal  Buffer  and  the  other  received  Pro-Organic 
Buffer.  The  luminescence  of  all  the  samples  was  measured 
after  an  exposure  time  of  1  h.  In  the  absence  of  the  toxic  sub¬ 
stances,  the  in  vivo  luminescence  remained  stable,  while  if  there 
were  toxic  substances  present,  the  luminescence  decreased  with 
respect  to  the  controls. 

2.2.  Toxicological  benchmark  concentrations  and  test 
chemicals 

To  be  useful,  toxicity  sensors  should  respond  to  chemical 
concentrations  at  levels  relevant  to  human  health.  The  Army 
user  group  recommended  that,  for  a  given  chemical,  a  toxic¬ 
ity  sensor  should  respond  to  concentrations  exceeding  the  7- 
to  14-day  Military  Exposure  Guideline  (MEG)  levels,  assum¬ 
ing  water  consumption  of  15  L/day  typical  of  arid  environments 
(USACHPPM,  2004).  Although  MEGs  are  not  enforceable  mili¬ 
tary  standards,  the  MEGs  provide  a  reference  point  above  which 
adverse  effects  may  be  expected.  The  estimated  human  lethal 
concentration  (HLC)  provided  an  upper  limit  for  toxicity  sen¬ 


sor  response.  HLCs  were  estimated  from  human  lowest  lethal 
dose  (LDlo)  calculated  from  either  accidental  human  poisoning 
data  or  rodent  LD50  data  (TERA,  2004);  when  available,  esti¬ 
mates  based  on  human  data  were  used.  Doses  were  converted 
to  concentrations  assuming  a  70  kg  weight  and  15  L  of  water 
consumed. 

Test  chemicals  recommended  by  the  Army  user  group 
(Table  1)  represent  different  modes  of  toxic  action  and  include 
some  possible  threat  chemicals  as  well  as  chemicals  found  in 
source  or  product  drinking  waters  that  could  cause  inappropri¬ 
ate  toxicity  sensor  responses  (ammonia,  copper,  and  residual 
chlorine).  Deionized  water  and  very  hard  water  blanks  were 
included  as  well.  Test  chemical  stability  in  water  was  a  criterion 
considered  in  the  selection  process.  Although  the  importance 
of  chemical  mixtures  in  environmental  contamination  events  is 
recognized,  and  the  ability  to  directly  measure  the  toxicity  of 
mixtures  is  an  important  capability  of  toxicity  sensors,  the  lack 
of  MEGs  and  human  lethality  information  for  chemical  mix¬ 
tures  led  to  a  decision  to  focus  this  effort  on  single  chemicals 
only. 

2.3.  Blind  sample  preparation  and  testing 

Test  solutions  were  prepared  at  and  shipped  as  coded  samples 
to  participating  laboratories  from  Battelle  Memorial  Institute 
(Columbus,  OH).  Chemicals  were  obtained  from  Fisher  (Fair- 
lawn,  NJ)  or  ChemService  (West  Chester,  PA).  Residual  chlorine 
samples  were  prepared  in  chlorine  demand-free  water.  As  a 
quality  control  measure,  the  actual  concentrations  of  each  solu¬ 
tion  prepared  and  shipped  to  the  participating  laboratories  were 
determined  by  analytical  measurement  at  the  US  Army  Center 
for  Environmental  Health  Research  (Ft.  Detrick,  MD).  The  end¬ 
point  concentrations  reported  were  corrected  for  the  difference 
between  the  nominal  and  actual  concentration  of  the  stock  solu¬ 
tion  supplied  each  laboratory.  In  most  cases,  the  difference  was 
less  then  15%. 

The  coded  solutions  were  shipped  in  random  order  to  the 
participating  laboratories.  With  the  exception  of  toluene,  the  sta¬ 
bility  of  the  samples  over  a  2-week  period  had  been  confirmed 


Table  1 

Chemicals  evaluated 


Chemical  (concentration  reported  as) 

Chemical  abstract  service  (CAS)  number 

MEG  (mg/L) 

HLC  (mg/L) 

Aldicarb 

116-06-03 

0.005 

0.047 

Ammonia 

7664-41-7 

30 

72.6 

Copper  sulfate  (Cu+2) 

7758-98-7 

0.14 

92.9 

Mercuric  chloride  (Hg+2) 

7487-94-7 

0.001 

24.1 

Methamidophos 

10265-92-6 

0.002 

1.4 

Nicotine 

54-11-5 

0.13 

1.87 

Paraquat  dichloride  (cation) 

4685-14-7 

0.05 

3 

Phenol 

108-95-2 

3 

65.3 

Sodium  arsenite  (As+3) 

7784-46-5 

0.02 

1.9 

Sodium  cyanide  (CN_) 

143-33-9 

2 

2.5 

Sodium  hypochlorite  (residual  chlorine) 

7681-52-9 

- 

- 

Sodium  pentachlorophenate  (anion) 

131-52-2 

0.14 

65.3 

Toluene 

108-88-3 

1.00 

2800 

Deionized  water  blank 

- 

- 

- 

Very  hard  water  blank  (Marking  and  Dawson,  1973) 

- 

- 

- 
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prior  to  the  start  of  this  study.  Because  of  its  volatility,  toluene 
was  to  be  analyzed  as  soon  as  possible  after  receipt.  While  the 
stability  of  the  nicotine  samples  was  confirmed,  previous  experi¬ 
ence  with  nicotine  caused  concern  about  its  degradation  in  water. 
Because  of  this,  the  nicotine  samples  were  required  to  be  ana¬ 
lyzed  as  soon  as  possible  after  receipt.  Otherwise,  the  sample 
maximum  holding  time  prior  to  analysis  was  two  weeks.  Par¬ 
ticipating  test  laboratories  were  not  told  of  the  identity  of  the 
chemicals  or  of  the  MEG  concentration  levels,  but  they  were 
told  the  concentration  of  the  samples  they  received  so  accurate 
endpoint  concentrations  could  be  reported.  For  each  chemical 
that  was  detected  during  initial  range-finding  tests,  participat¬ 
ing  laboratories  performed  three  definitive  tests.  If  no  response 
was  observed  for  the  undiluted  blind  sample,  the  original  sample 
concentration  was  repeated  in  triplicate  to  confirm  the  lack  of 
response. 

2.4.  Data  analysis 

The  response  endpoint  (RE)  for  the  toxicity  sensors  was  the 
EC50  value  generated  from  a  linear  regression  of  the  results, 
except  for  the  ECIS  and  SOS  cytosensor  systems  for  which  the 
RE  was  a  minimum  detectable  concentration  determined  from 
statistical  hypothesis  testing.  A  simple  way  of  scoring  toxicity 
sensor  performance  was  to  add  up  the  number  of  chemicals  each 
sensor  detected  between  the  MEG  level  and  the  HLC.  In  addi¬ 
tion,  a  scoring  system  was  used  to  determine  the  proximity  of 
the  RE  to  the  MEG  level  and  HLC  for  all  12  chemicals  tested 
having  both  MEGs  and  HLCs: 

^  log(RE)  -  log(MEG) 

^  log(HLC)  -  log(MEG) 

If  the  toxicity  sensor  responded  at  the  MEG,  it  received  a  score 
of  1 .0;  scores  decreased  as  the  response  concentration  increased 
above  the  MEG,  reaching  0.0  at  the  HLC.  The  score  for  an  RE 
above  the  HLC  or  below  the  MEG  was  0.0.  An  ideal  sensor  (one 
for  which  each  RE  was  at  the  MEG  level)  would  have  a  total 
score  of  12. 

Further  analyses  of  toxicity  sensor  performance  considered 
whether  the  sensor  responded  to  the  deionized  or  hard  water 
blanks  or  to  residual  chlorine.  Test  reproducibility  was  deter¬ 
mined  by  calculating  the  median  coefficient  of  variation  for  those 
chemicals  for  which  a  toxicity  sensor  had  triplicate  definitive 
test  results  providing  an  RE  value.  The  toxicity  sensor  failure 
rate  (number  of  tests  started  but  not  successfully  completed  as 
a  percentage  of  the  number  of  tests  attempted)  reported  by  par¬ 
ticipating  laboratories  was  evaluated. 

3.  Results  and  discussion 

Table  2  lists  the  sensors  in  order  of  their  rank  based  on  the 
number  of  chemicals  for  which  the  RE  was  between  the  MEG 
concentration  and  the  HLC.  On  this  basis,  the  Microtox,  ECIS 
and  Hepatocyte  LDL  uptake  systems  each  detected  six  chem¬ 
icals.  The  order  is  the  same  using  the  scoring  system,  which 
accounts  for  the  proximity  of  the  RE  between  the  MEG  and 
the  HLC,  except  that  the  Hepatocyte  LDL  uptake  sensor  drops 


Table  2 


Toxicity  sensors  ranked  by  score 


Toxicity  sensor 

Number  of  chemicals 

detected  between  the 

MEG  and  HLC 

Total  score  for 

all  chemicals 

Microtox 

6 

3.85 

ECIS 

6 

2.58 

Hepatocyte  LDL  uptake 

6 

1.35 

SOS  cytosensor 

4 

2.41 

Neuronal  microelectrode 

4 

1.82 

array  (nine  chemicals  only) 

Mitoscan  ETR 

3 

1.60 

S.  meliloti  toxicity  test 

3 

1.53 

ToxScreen  II  Metals 

3 

1.43 

ToxScreen  II  Organics 

3 

1.28 

Toxi-Chromotest 

2 

1.09 

Mitoscan  RET 

1 

0.55 

Eclox 

1 

0.01 

several  places  because  although  it  detected  more  chemicals  in 
the  range,  the  response  concentrations  were  not  as  close  to  the 
MEG  level.  The  neuronal  microelectrode  array  testing  labo¬ 
ratory  completed  blind  sample  tests  with  five  chemicals,  and 
unpublished  data  were  available  for  four  additional  chemicals 
(ammonia,  arsenic,  mercury,  and  cyanide). 

Since  no  one  toxicity  sensor  could  detect  the  full  set  of  12 
chemicals  in  the  desired  sensitivity  range,  the  top  three  toxic¬ 
ity  sensors  were  considered  together  as  a  potential  toxicity  test 
battery  and  scored  collectively. 

Table  3  shows  the  combined  scoring  of  the  Microtox,  ECIS, 
and  Hepatocyte  LDL  uptake  systems.  The  combined  scoring 
uses  the  score  of  the  most  sensitive  sensor  for  each  chemical, 
which  simulates  how  a  system  made  up  of  three  independent 
sensors  analyzing  the  same  water  sample  could  improve  per¬ 
formance  compared  to  any  single  sensor.  For  example,  only 
ECIS  detected  ammonia  within  the  MEG-HLC  range,  while 
only  the  Hepatocyte  LDL  uptake  test  detected  paraquat  in  the 
same  range.  The  benefit  of  combining  the  sensors  is  reflected  in 
the  combined  score  of  5.54,  compared  with  3.85  from  Microtox, 
the  highest  individual  score.  In  addition,  three  more  chemicals 

Table  3 


Combined  scoring  for  the  top-ranked  toxicity  sensors 

Chemicals 

Microtox 

ECIS 

Hepatocyte 
LDL  uptake 

Combined 

Aldicarb 

- 

- 

- 

- 

Ammonia 

- 

1.00 

- 

1.00 

Arsenic 

- 

0.20 

0.16 

0.20 

Copper 

0.81 

0.40 

0.13 

0.81 

Cyanide 

1.00 

- 

- 

1.00 

Mercury 

0.49 

0.14 

0.01 

0.49 

Methamidophos 

- 

- 

- 

- 

Nicotine 

- 

- 

- 

- 

Paraquat 

- 

- 

0.28 

0.28 

Phenol 

0.28 

- 

0.49 

0.49 

Pentachlorophenate 

0.58 

0.39 

0.29 

0.58 

Toluene 

0.69 

0.46 

- 

0.69 

Combined  score 

3.85 

2.58 

1.35 

5.54 

Chemicals  detected 

6 

6 

6 

9 

Table  4 

Response  endpoints  (REs)  for  each  sensor  and  chemical  tested 


Aldicarb 

NH, 

As+3 

Cu+2 

CN- 

Hg*2 

Methamidophos 

Nicotine 

Paraquat 

Phenol 

Pentachloro- 

phenate 

Toluene 

Chlorine 

DI 

water 

Very  hard 

water 

Microtox 

45.8 

NRa 

24.7 

0.47  (0.81) 

2.00 

(1.0) 

NR 

0.18(0.49) 

NR 

61.0 

347 

27.7  (0.28) 

1.86(0.58) 

11.6  (0.69) 

0.28 

NR 

NR 

ECIS 

241 

30.0(1.0) 

0.77  (0.20) 

6.93  (0.40) 

6.00  (0.14) 

89.2 

640 

NR 

73.3 

6.12(0.39) 

72.5  (0.46) 

NR 

NR 

NR 

Hepatocyte  LDL  uptake*1 

NR 

NR 

0.90  (0.16) 

40.2  (0.13) 

6.91 

24.0  (0.01) 

4.66 

15.4 

0.95  (0.28) 

14.6  (0.49) 

11.3(0.29) 

NR 

5.46 

ND 

ND 

SOS  cytosensor 

NR 

NR 

4.2 

3.45  (0.51) 

NR 

1.5  (0.28) 

NR 

NR 

NR 

29.3  (0.26) 

6.72  (0.37) 

NR 

NR 

NR 

NR 

Neuronal  microelectrode 

0.0074 

10.2C 

5.6C 

NDd 

5.20c 

4.00c  (0.18) 

1 .08  (0.04) 

700 

0.00002 

5.94  (0.78) 

ND 

ND 

ND 

ND 

ND 

array 

Mitoscan  ETR 

(0.83) 

NR 

NR 

NR 

0.29  (0.89) 

0.052 

0.14(0.51) 

NR 

NR 

NR 

662 

19.6  (0.20) 

NR 

NR 

NR 

NR 

ToxScreen  II  Metals 

NR 

NR 

5.58 

1.19(0.67) 

<BS 

0.09  (0.55) 

NR 

NR 

54.6 

877 

18.8  (0.20) 

NR 

1.65 

NR 

NR 

ToxScreen  II  Organics 

NR 

NR 

8.63 

200 

0.12 

0.04  (0.63) 

NR 

NR 

93.8 

27.4  (0.28) 

0.008 

159  (0.36) 

0.20 

NR 

NR 

Toxi-Chromotest 

NR 

NR 

3.80 

NR 

0.33 

0.12(0.53) 

NR 

NR 

152 

1060 

2.0  (0.57) 

NR 

NR 

NR 

NR 

S.  meliloti  toxicity  test 

NR 

132 

89.2 

179 

3.08 

0.08  (0.56) 

105 

926 

8.50 

1.66 

1.03  (0.67) 

268  (0.30) 

NR 

NR 

1.67 

Mitoscan  RET 

NR 

NR 

NR 

0.02 

NR 

0.09  (0.55) 

NR 

NR 

NR 

303 

0.06 

NR 

1.66 

NR 

NR 

Eclox 

NR 

NR 

260 

88.9  (0.01) 

7.15 

28.6 

NR 

167 

744 

0.79 

NR 

NR 

0.38 

NR 

NR 

Blind  sample  concentration 

500 

300 

200 

1400 

20 

100 

200 

1300 

500 

3000 

140 

500 

10 

NAe 

300' 

(mg/L) _ 

Concentrations  are  in  mg/L;  responses  between  the  MEG  concentration  and  the  HLC  are  shaded  and  corresponding  calculated  scores  are  shown  in  parentheses. 
a  NR — no  response  at  the  blind  sample  concentration  (the  maximum  concentration  that  could  be  tested). 
b  Testing  was  not  done  using  blind  samples. 
c  G.  Gross,  University  of  North  Texas  (unpublished  data). 
d  ND — not  determined;  test  data  not  available. 
e  NA — not  applicable. 
f  Hardness,  reported  as  mg/L  as  CaC03. 
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were  detected  when  the  results  were  combined,  so  that  9  of 
the  12  chemicals  tested  were  detected  in  the  MEG-HLC  range 
by  the  three  sensors  taken  together.  The  three  chemicals  not 
detected  were  aldicarb,  nicotine,  and  methamidophos.  All  three 
are  neurotoxicants,  and  both  aldicarb  and  methamidophos  are 
acetylcholinesterase  inhibitors. 

A  more  comprehensive  summary  of  toxicity  sensor  responses 
is  shown  in  Table  4.  The  sensors  are  listed  in  the  same  order  as 
in  Table  2,  and  sensor  responses  within  the  MEG-HLC  range 
are  shaded.  Because  the  Microtox,  ECIS,  and  the  Hepatocyte 
LDL  uptake  systems  together  identified  9  of  12  chemicals  in  the 
desired  sensitivity  range,  the  question  is  whether  any  of  the  other 
toxicity  sensors,  if  added  to  this  potential  toxicity  test  battery, 
would  either  detect  additional  chemicals  or  respond  closer  to  the 
MEG  concentrations. 

Although  none  of  the  tested  sensors  detected  nicotine,  the 
neuronal  microelectrode  array  was  able  to  detect  aldicarb  and 
methamidophos  with  the  desired  sensitivity.  Higher  individual 
sensor  scores  than  for  Microtox,  ECIS,  or  the  Hepatocyte  LDL 
uptake  systems  were  found  for  four  other  chemicals:  copper 
(Mitoscan  ETR  -  0.89  versus  Microtox  -  0.81);  mercury  (sev¬ 
eral  sensors  with  the  highest  being  ToxScreen  II  Organics  -  0.63 
versus  Microtox  -  0.49);  phenol  (neuronal  microelectrode  array 
-  0.78  versus  Hepatocyte  LDL  uptake  -  0.49);  pentachlorophen- 
ate  (S.  meliloti  Test  -  0.67  versus  Microtox  -  0.58).  These 
score  differences  corresponded  to  concentrations  of  approxi¬ 
mately  0.2  mg/L  for  copper,  0. 1  mg/L  for  mercury,  8.7  mg/L  for 
phenol,  and  0.8  mg/L  for  pentachlorophenate.  These  relatively 
small  sensitivity  differences  do  not  in  and  of  themselves  support 
adding  any  sensors  to  the  three  sensors  previously  evaluated 
together. 

Table  5  summarizes  how  increasing  the  number  of  toxicity 
sensors  adds  to  the  number  of  chemicals  detected  within  the 
MEG-HLC  range.  Sensors  are  listed  starting  with  the  highest 
scoring  Microtox  (Table  2),  followed  by  sensors  that  provide 
the  maximum  increase  in  the  number  of  additional  chemicals 
detected  when  combined  with  the  preceding  sensors.  None  of 
the  other  sensors  besides  these  four  provided  additional  detec¬ 
tion  capabilities.  Although  the  neuronal  microelectrode  array 
deserves  further  consideration  because  of  its  ability  to  detect 
aldicarb  and  methamidophos  in  the  desired  sensitivity  range, 
the  neurons  also  responded  to  paraquat  at  a  concentration  over 
three  orders  of  magnitude  below  the  MEG. 

The  issue  of  sensitivity  to  toxicants  must  be  considered  within 
the  perspective  of  the  benchmark  concentrations.  In  particular, 
the  HLCs  are  only  estimates,  based  on  frequently  incomplete 
or  absent  human  poisoning  data  or  extrapolations  from  rodent 
LD50  data.  For  aldicarb,  nicotine,  and  cyanide,  the  MEG-HLC 


range  is  less  than  a  factor  of  10,  which  may  reflect  conserva¬ 
tive  assumptions  made  in  developing  the  HLCs.  In  addition, 
human  lethal  doses  were  converted  to  concentrations  using  a 
1 5  L  volume  of  water,  to  be  consistent  with  the  daily  water  con¬ 
sumption  appropriate  to  the  MEG  values  chosen  by  the  Army 
user  group.  However,  a  more  accurate  estimation  of  a  lethal 
concentration  would  have  included  a  toxicokinetic  analysis  to 
account  for  variations  in  absorption,  metabolism,  and  excretion 
for  a  lethal  chemical  dose  consumed  over  time  in  15  L  of  water. 

Table  6  compares  the  response  concentrations  identified  in 
this  study  to  available  literature  values.  Caution  should  be  used 
when  making  comparisons  with  literature  data,  given  the  diffi¬ 
culty  in  ensuring  comparable  methodologies  and  biological  test 
systems.  For  a  given  toxicity  sensor  and  test  chemical,  most  of 
the  literature  values  and  the  data  from  this  study  are  within  the 
same  response  category.  That  is,  the  responses  are  either  both 
within  the  MEG-HLC  range  or  both  outside  the  range.  How¬ 
ever,  a  few  literature  values  differ  substantially  from  the  toxicity 
sensor  data  compiled  for  this  study,  and  many  of  the  greatest 
differences  are  found  with  the  ToxScreen  II  or  S.  meliloti  tox¬ 
icity  tests.  One  contributing  factor  might  be  the  relatively  high 
variability  in  these  test  systems,  as  discussed  below. 

Data  on  other  factors  besides  sensitivity  to  toxicants  that 
could  help  discriminate  among  toxicity  sensors  were  collected 
as  part  of  this  study  (Table  7).  Residual  chlorine  concentration 
in  military  water  supplies  are  typically  maintained  at  2  mg/L, 
and  five  of  the  sensors  responded  to  residual  chlorine  levels  in 
this  range,  including  Microtox  and  the  Hepatocyte  LDL  uptake 
sensors.  Although  it  would  be  convenient  if  the  sensors  would 
not  respond  to  residual  chlorine,  chlorine  can  be  removed  prior 
to  analysis  using  sodium  thiosulfate  or  another  similar  reduc¬ 
ing  agent  (Yonkos  et  al.,  2001).  There  was  only  one  instance  of 
response  to  either  the  DI  water  blank  or  the  hard  water  sam¬ 
ple.  The  S.  meliloti  toxicity  test  produced  a  false  indication 
of  toxicity  when  exposed  to  very  hard  water,  but  S.  meliloti  is 
known  to  be  sensitive  to  calcium  and  other  divalent  cations  in 
water  (Botsford,  2002).  Although  adding  a  chelating  agent  could 
remove  divalent  cation  responses,  this  would  likely  reduce  sen¬ 
sitivity  to  toxic  metals  of  concern,  such  as  Hg2+.  The  median 
coefficients  of  variation  (CVs)  provide  a  rough  estimate  of  the 
reproducibility  of  the  REs  generated  by  the  toxicity  sensors.  CV 
values  ranged  from  6  to  54%  with  all  but  three  sensors  being  less 
than  20%.  The  ToxScreen  and  S.  meliloti  toxicity  tests  had  the 
highest  CVs.  The  CVs  of  the  toxicity  sensors  in  the  candidate 
test  battery  were  less  than  15%. 

Most  of  the  sensors  had  a  very  low  reported  failure  rate,  but 
the  neuronal  microelectrode  array  system  had  approximately  a 
65%  failure  rate,  almost  entirely  due  to  shipping  problems.  When 


Table  5 

Value  of  additional  toxicity  sensors  for  increasing  the  number  of  chemicals  detected 


Added  sensor 

Cumulative  chemicals  detected 

Additional  chemicals  detected 

Microtox 

6 

Copper,  cyanide,  mercury,  phenol,  pentachlorophenate,  toluene 

Hepatocyte  LDL  uptake 

8 

Arsenic,  paraquat 

Neuronal  microelectrode  array 

10 

Aldicarb,  methamidophos 

ECIS 

11 

Ammonia 
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Table  6 

Comparison  of  toxicity  sensor  responses  with  literature  data 
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Toxicity  test3 


Data  source  As+ 


Cu+ 


CN- 


Hg+ 


Nicotine  Paraquat  Phenol  Pentachlorophenate  Toluene  Chlorine 


Microtox 


Neuronal  microelectrode 
array 

Mitoscan  ETR 


ToxScreen  II  Metals 


ToxScreen  II  Organics 


Toxi-Chromotest 


This  study  24.7 
Literature  2784b 


0.47  2.00  0.18 

61.0  347 

27.7  1.86  11.6 

0.64b 

7.17b,c 

0.03b’ 

36.3b'c  436b 

34.2d  0.70d  19. 7d 

This  study 
Literature 

This  study 
Literature 

This  study 
Literature 

This  study 
Literature 

This  study 
Literature 


5.6 

0.5-106 


4.00 


l-10e 


662 

133f 


1.19 


0.09 


8.63 


is 


0.007® 

200 

0.028 


0.03S 


0.04 


0.0038 


0.008 

0.0148 


3.80 

0.8h 


0.33 
0.1 7h 


0.12 


0.1 2h 


Eclox 


This  study 
Literature 


88.9 


242J 


7.15 

0.01s 


28.6 


Iff 


0.79 

0.60s 


S.  meliloti  toxicity  test 

This  study 

89.2 

179 

3.08 

0.08 

926 

8.50 

1.66 

1.03 

268 

Literature 

1.7‘ 

0.441 

5.751 

O.Ol1 

9901 

47.9‘ 

12141 

0.141 

2171 

Mitoscan  RET 

This  study 

0.02 

0.09 

303 

0.06 

Literature 

0.38f 

0.13f 

133f 

0.08f 

0.38 

0.03s 


Comparisons  are  made  for  test  results  reported  in  Table  4  for  which  endpoint  values  could  be  computed  and  literature  values  were  available.  Shaded  values  are  those 
within  MEG-HLC  range  for  the  chemical. 

a  No  comparable  literature  data  were  found  for  any  chemical  tested  with  the  ECIS,  Hepatocyte  LDL  uptake,  or  SOS  cytosensor  tests. 
b  Clemedson  et  al.  (1996). 

c  Five-minute  EC50  data;  15-min  data  not  available. 
d  Kaiser  and  Palabrica  (1991). 
e  O’Shaughnessy  et  al.  (2004). 
f  Blondin  et  al.  (1989). 

8  Ulitzur  et  al.  (2002). 
h  Reinhartz  et  al.  (1987). 

1  Botsford  (2002). 

1  Sawcer  and  Thorpe  (2001);  data  are  reported  for  an  assay  said  to  produce  results  equivalent  to  Eclox. 


Table  7 

Other  factors  differentiating  toxicity  sensors 


Toxicity  sensor 

RE  for  chlorine  (mg/L) 

Lalse  positive  for  hard  water 

Lalse  positive  for  DI  water 

Overall  median  CV 

Lailure  rate  (%) 

Microtox 

0.28 

No 

No 

12 

0 

ECIS 

>10 

No 

No 

NA 

17 

Hepatocyte  LDL  uptake 

5.46 

No  data 

No  data 

12.7 

5-10 

SOS  cytosensor  system 

>10 

No 

No 

NA 

2 

Neuronal  microelectrode  array 

No  data 

No  data 

No  data 

11 

65 

Mitoscan  (ETR) 

>10 

No 

No 

7 

0 

S.  meliloti  toxicity  test 

>10 

Yes 

No 

28 

2 

ToxScreen  II-Metals 

1.65 

No 

No 

54 

10 

ToxScreen  Il-Organics 

0.20 

No 

No 

31 

10 

Toxi-Chromotest 

>10 

No 

No 

14 

0 

Mitoscan  (RET) 

1.66 

No 

No 

18 

0 

Eclox 

0.38 

No 

No 

6 

0 

the  problems  were  corrected,  the  failure  rate  was  only  6%.  The  4.  Conclusions 
ECIS  had  a  failure  rate  of  17%,  which  was  due  primarily  to 
an  improperly  functioning  incubator;  the  failure  rate  excluding 
incubator  problems  was  6.7%. 


The  analysis  of  the  twelve  chemicals  using  10  different  sen¬ 
sors  resulted  in  the  recommended  combination  of  Microtox, 
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ECIS,  and  the  Hepatocyte  LDL  uptake  sensors  (Table  5).  These 
three  sensors  detected  9  out  of  12  chemicals  in  the  MEG-HLC 
range  and  did  so  with  sensitivity  similar  to  if  not  greater  than 
those  of  other  sensors  able  to  detect  the  same  contaminants. 
Although  the  neuronal  microelectrode  array  could  be  consid¬ 
ered  for  further  work  because  of  its  ability  to  detect  aldicarb  and 
methamidophos  and  its  sensitivity  to  phenol,  oversensitivity  to 
paraquat  and  shipping  problems  do  not  support  its  inclusion  at 
this  time.  For  the  further  development  of  a  toxicity  sensor  system 
for  evaluating  Army  water  supplies,  the  results  of  this  toxicity 
evaluation  will  be  combined  with  information  on  other  factors 
such  as  size,  weight,  and  logistical  issues  as  part  of  a  formal 
downselection  process  (ECBC  DAT,  2004). 

5.  Recommendations 

The  following  steps  are  recommended  for  future  efforts  to 
identify  toxicity  sensors  suitable  for  use  in  drinking  water  eval¬ 
uations: 

•  Clearly  define  the  intended  application  for  the  toxicity  sen¬ 
sors,  with  input  from  the  user  community  if  possible. 

•  Based  on  the  intended  use(s),  define  acceptable  sensitivity 
ranges  for  sensor  response.  Both  an  upper  and  a  lower  con¬ 
centration  boundary  should  be  consistently  defined. 

•  Evaluate  the  toxicity  sensors  with  chemicals  representing 
modes  of  toxic  action  of  concern.  If  several  laboratories  are 
involved  in  sensor  testing,  provide  test  solutions  as  blind  sam¬ 
ples  and  take  steps  to  ensure  sample  stability  throughout  the 
testing  period. 

•  Apply  consistent  metrics  for  determining  the  relative  useful¬ 
ness  of  the  toxicity  sensors  for  the  intended  purpose.  The 
simple  metrics  used  in  this  study  should  be  adequate  for  a 
screening  evaluation.  For  more  definitive  performance  eval¬ 
uations,  other  approaches  such  as  Receiver  Operator  Charac¬ 
teristic  (ROC)  curves  (Beck  and  Shultz,  1986)  may  be  useful. 
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